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We demonstrate that time-delayed feedback control can be improved by adaptively tuning the feedback gain. 
This adaptive controller is applied to the stabilization of an unstable fixed point and an unstable periodic orbit 
embedded in a chaotic attractor. The adaptation algorithm is constructed using the speed-gradient method 
of control theory. Our computer simulations show that the adaptation algorithm can find an appropriate 
value of the feedback gain for single and multiple delays. Furthermore, we show that our method is robust 
to noise and different initial conditions. 



The control of nonlinear systems is a central topic 
in dynamical system theory, with a diverse range 
of applications. Adaptive control schemes have 
emerged as a new type of control method that 
optimizes the control parameters with respect to 
an appropriate goal function, thereby minimiz- 
ing, for instance, the consumed power or the time 
needed to reach the control goal. In this work we 
combine time-delayed feedback control, an estab- 
lished method from chaos control, with an adap- 
tive speed-gradient scheme to optimize the con- 
trol force. We demonstrate how this combined 
scheme can be utilized to stabilize various target 
states, e.g., unstable fixed points or periodic or- 
bits, with little or no apriori knowledge about the 
target state. We also investigate the robustness 
of the method to noise and perturbations. 



I. INTRODUCTION 

Stabilization of unstable and chaotic systems forms an 
important field of research in nonlinear dynamics. A vari- 
ety of control schemes have been developed to control pe- 
riodic orbits as well as steady states^ 2 -. A simple and effi- 
cient scheme, introduced by Pyragas 3 -, is known as time- 
delay auto synchronization (TDAS). This control method 
generates a feedback from the difference of the current 
state of a system to its counterpart some time units r in 
the past. Thus, the control scheme does not rely on a 
reference system and has only a small number of control 
parameters, i.e., the feedback gain K and time delay r. 
It has been shown that TDAS can stabilize both unstable 
periodic orbits, e.g., embedded in a strange attractor^ 
as well as unstable steady states^—. In the first case, 
TDAS is most efficient and noninvasive if r corresponds 
to an integer multiple of the minimal period of the orbit. 



In the latter case, the method works best if the time de- 
lay is related to an intrinsic characteristic timescale given 
by the imaginary part of the system's eigenvalue^. A 
generalization of the original Pyragas scheme, suggested 
by Socolar et al£, uses multiple time delays. This ex- 
tended time-delay auto synchronization (ETDAS) intro- 
duces a memory parameter R, which serves as a weight 
of states further in the past. In Rcf. [9J it is shown that, 
this method is able to control an unstable fixed points 
for a larger range of parameters compared to the original 
TDAS scheme. A variety of analytic results about time- 
delayed feedback control are knowr>i2r— , for instance, in 
the case of long time delays^, transient behavior—, un- 
stable spatio-temporal patterns^, or regarding the odd 
number limitation-^, which was refuted in Refs. [l8| and 

M 

In the present paper, we apply the speed-gradient 
method 2 ^— to adaptively tune the feedback gain K, 
which is used in both TDAS and ETDAS control meth- 
ods, and utilize this scheme to stabilize an unstable focus 
in a generic model, and an unstable periodic orbit em- 
bedded in a chaotic attractor. The former model is the 
generic linearization of a system with an unstable fixed 
point close to a Hopf bifurcation. The speed-gradient 
method is a well known adaptive control technique that 
minimizes a predefined goal function by changing an ac- 
cessible system parameter appropriately. The adaptation 
of the feedback gain may be useful, in particular, for sys- 
tems with slowly changing parameters or when the do- 
main of stability is unknown. There are several other ap- 
proaches to adaptive control of nonlinear systems in the 
control literature^— . Here we have chosen the speed- 
gradient method because it is simple and robust. 

This paper is organized as follows: In Sec. UH we de- 
velop the adaptation algorithm using the example of an 
unstable focus. In Sec. lIIIl we apply the adaptive control 
scheme to stabilize an unstable periodic orbit embedded 
in the chaotic attractor of the Rossler system. Finally, 



we conclude with Sec. [IV 



II. STABILIZATION OF AN UNSTABLE FIXED POINT 

First, we will consider stabilization of an unstable fixed 
point by time-delayed feedback. Unlike in previous works 
(see e.gjiui and references therein), we do not fix the feed- 
back gain a priori, but tune it adaptively. We consider 
a general dynamical system given by a nonlinear vector 
field f : 



X(i) = f [X(i)] 



(1) 



with X € M. n and an unstable fixed point X* solving 
f(X*) = 0. The stability of this fixed point is obtained 
by linearizing the vector field around X* . Without loss of 
generality, let us assume X* =0. In the following we will 
consider the generic case of a two-dimensional unstable 
focus, i.e., a system close to a Hopf bifurcation, for which 
the linearized equations can be written in center manifold 
coordinates x,y GM. a,s follows: 



x = Xx + u> y 
y = -ux + Xy, 



(2a) 
(2b) 



where A and u> are positive real numbers. A may be 
viewed as the bifurcation parameter governing the dis- 
tance from the instability threshold, i.e., a Hopf bifurca- 
tion, and uj is the intrinsic cigenfrequency of the focus. 
For notational convenience, Eq. ([2]) can be rewritten as 



The eigenvalues Ao of the 2x2 matrix A are given by 
Ao = A ± ius, so that for A > and u ^ the fixed 
point is an unstable focus. We now apply time-delayed 
feedback control^ in order to stabilize this fixed point: 

x(t) = A x(t) + u y(t) - K[x{t) - x(t - r)] (4a) 
y(t) = -ux(t) + Xy(t) - K[y(i) - y(t - r)], (4b) 

where the feedback gain K and the time delay r are real 
numbers. We assume that the value of t is known and 
appropriately chosen. Mathematically speaking, the goal 
of the control method is to change the sign of the real 
part of the eigenvalue, leading to a decay of perturbations 
from the target fixed point. 

Since the control force applied to the ith component 
of the system involves only the same component, this 
control scheme is called diagonal coupling 2 ^ and is suit- 
able for an analytical treatment. Note that the feed- 
back term vanishes if the fixed point is stabilized since 
x*(t — r) = x*(t) and y*(t — r) = y*(t) for all t, indicating 
the noninvasiveness of the TDAS method. 

To obtain an adaptation algorithm for the feedback 
gain K according to the standard procedure of the speed- 
gradient method 2 ^ -24 ' 29 , let us choose the goal function 
or cost function as follows: 

1 



X(i) =AX((). 



(3) 



Q(X) = | {[x(t) - x(t r)] 2 + [y(t) y(t r)] 2 } . (5) 

Successful control yields Q(X(i)) — > as t — > oo. The 
speed-gradient algorithm in the differential form is given 
by K = — jVkQ, where 7 > is the adaptation gain 
and Vjf denotes d/dK . Thus, we need to calculate the 
gradient - with respect to the feedback gain K - of the 
rate of change of the cost function. For the above cost 
function Eq. ([5]) wc obtain: 



Q = [x{t) - x(t - r)][x(t) - x(t - r)] + [y(t) - y(t - r))][y(i) - y(t - r)]. 



(G) 



The time derivatives of x and y are given by Eqs.(|3]). Thus, the speed-gradient method leads to the following 
equation for the feedback gain: 

K(t) = 7 {[z(i) - x(t - r)][x(t) - 2x(t - r) + x(t - 2r)] + [y(t) - y(t - r)][y(t) - 2y(t - r) + y(t - 2r)]}. (7) 



Owing to homogeneity the right hand sides of Eqs. (j4|) 
and (O, without loss of generality the adaptation gain 
7 can be chosen as 1, because Eqs. (@| and (J7]) can 
be rescaled by transformation x(t) — > x(t)/^/j and 
y(t) — ► !/(t)/V7- 

Figure [1] depicts the time series of x and K according 
to Eqs. (j4|) and (J7|) for different initial conditions x(0) € 
[0.02, 0.5] in steps of 0.02 from light (green) to dark (blue) 
and y(0) = 0. In all simulations x(t) = y(t) = for 
t < and K(t) = for t < It. The parameters are 
chosen as A = 0.5, w = n, and r = 1. Figure HJa) shows 
that the adaptation algorithm works for a large range of 
initial conditions. Naturally, for initial conditions close 



I 

to the fixed point the goal is reached faster. If the system 
starts initially too far from the fixed point (x(0) > 0.85, 
y(0) — 0) the control fails (curves not shown). Note, 
however, that the basin of attraction can be enlarged 
by increasing 7. In fact, due to the scaling, invariance, 
the maximum value of |a;(0)| that still leads to successful 
control is proportional to ^7. 

In Ref. it was shown that in the (K, r)-planc tongues 
exist for which the fixed point can be stabilized, i.e., for 
a given r there is a if-intcrval for which the control is 
successful. As can be seen in Fig. [TJb), the adaptive 
algorithm converges to some appropriate value of K in 
this interval depending upon the initial conditions. 




FIG. 1. (Color online) Adaptive control of the fixed point: 
(a) Time series x(t) and (b) feedback gain K(t) for different 
initial conditions: x(0) £ [0.02, 0.5] in steps of 0.02 (from 
light (green) to dark (blue); in panel (b) from top to bottom), 
y(0) = 0. Parameters: A = 0.5, w = 7r, 7 = 1, t — 1. 



Figure [2] demonstrates that the algorithm works for 
a range of r, i.e., for any value of r within the do- 
main of stability of the TDAS control^. Black empty 
circles depict the transient time t c after which the con- 
trol goal is reached in dependence on the time delay r. 
This is the case if the cost function Q becomes suffi- 
ciently small. We define the transient time by the bound 
(Q) = f*°_ 2r Q(t')dt' < 2t x 1(T 10 . The dark (dark 
purple) shaded regions correspond to the analytically ob- 
tained r-intervals of the Pyragas control^. Inside these 
intervals, t c has a finite value confirming that the adap- 
tive control scheme adjusts the feedback gain K to an 
appropriate value. For a comparison with the transient 
time of TDAS sec Rcf. [l5| where a power law scaling 
t c ~ (K ~ K c )~ l with respect to the fixed feedback gain 
K has been found (here K c corresponds to the bound- 
aries of stability). The curves corresponding to non-zero 
memory parameter R (crosses and squares) will be dis- 
cussed below where the speed-gradient method is applied 
to the ETDAS scheme. 

For a thorough analysis of the stability of the fixed 
point, we perform a linear stability analysis for the sys- 
tem Eqs. IJ3J, J7]). This system has the fixed point 
(0,0, K*) for any K* = const. Linearization around the 
fixed point and the ansatz 5x, Sy, 5K ex exp(At) yields a 
transcendental eigenvalue equation 



= det 



\-K{l-er AT )-K 



oj 

A - K{\ - e- Ar ) - A 
-A 

A-n 



A[A + iu- K{\ - e- AT ) - A] [A- iw - K{1 - er AT ) - A] 



(8) 
(9) 



which can be solved numerically. This equation is equal 
to the case of Pyragas control with constant feedback 
gain considered in Ref. @ except for the factor A. Thus, 
the adaptively controlled system has an additional eigen- 
value at A = 0. It results from the translation invariance 
of the system in the direction of K on the fixed point line 
(0, 0, K). This means that the K values found in the case 
of the standard Pyragas control lead again to a stabiliza- 
tion of the fixed point. The advantage of an adaptive 
controller is that an appropriate feedback gain is realized 
in an automated way, i.e., without prior knowledge of the 
domain of stability, as long as a stability domain exists 
for this value of t. 

An additional advantage of an adaptive control scheme 
is that it allows one to follow slow changes of the system 
parameters, which are usually present in experimental 
situations. To test the ability of our adaptive control 
scheme to cope with such parameter drifts, we slowly 
vary A in the following way: \(t) = O.Of + 1.8 sin(0.001i). 
The result is illustrated in Fig. [3J In Fig. [2ta) the region 
of stability of the standard Pyragas control in the (A, K) 




FIG. 2. (Color online) Transient time t c after which the con- 
trol goal is reached in dependence of the delay time r for 
TDAS (black circles) and ETDAS with R = 0.35 ((blue) 
crosses), and R — 0.95 ((red) squares). The dark (dark pur- 
ple), medium (bright purple), and light (red) shaded regions 
denote the possible range of r for R = 0, 0.35, and 0.95, re- 
spectively. Parameters as in Fig. [TJ 



plane (see Ref. 0) is marked by green (gray) shading. 
If now A is slowly increased from its initial value 0.01, 
K follows the change in such a way that whenever the 
lower boundary of the stability region is crossed and the 



fixed point becomes unstable, the adaptation algorithm 
adjusts K such that the stable region is re-entered. This 
creates a step-like trajectory in the (A, K) plane, which is 
depicted as a red (solid) curve with an arrow. Finally, if A 
is decreased again, K does not change because it already 
has attained a value for which the control works in a 
broad A-interval resulting in a horizontal trajectory in the 
(A, K) plane. Fig. El^b) depicts the corresponding time 
series of K (t) as a blue (solid) curve, and of the drifting 
parameter A(i) as a red (dashed) curve, respectively. 
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FIG. 3. (Color online) Adaptive control of the fixed point for 
slowly drifting system parameter A. (a) Adaptive adjustment 
of K in the (A, K) plane. Green (gray) shaded region: re- 
gion of stability of the standard Pyragas control. Red (solid) 
line with arrow: adaptation of feedback gain if if A is slowly 
changed (A(t) = 0.01+1.8 sin(0.001t)) (b) Corresponding time 
series K(t) (blue solid line) and A(i) (dashed red line). Other 
parameters as in Fig. [TJ 

To test the robustness of the control algorithm, we add 
Gaussian white noise £j (i = 1,2) with zero mean and 



unity variance ((&(*)) = 0, (&(*)£j(i- 
to the system variables x and y: 



t')) = S ij 5(t-t')) 



x(t) = Xx(t) +Luy(t) 

-K(t)[x(t) -x(t 

y{t) =-ux(t)+Xy(t) 
-K(t)[y(t)-y(t- 



r)]+D£i(«) 



r)]+£>6(i), 



(10a) 

(10b) 



where D is the strength of the noise. 

In Fig.rjja) the ensemble average over 200 realizations, 



i.e., (x(t)} = 1/200 Ei=i3i(*), for D = 0- 1 (intermedi- 
ate noise) is depicted as a solid (red) curve. The thin 
(blue) curve exemplarily depicts one realization. The cor- 
responding standard deviation o x (t) of x(t) is shown as 




FIG. 4. (Color online) Robustness to noise, (a): Thick solid 
(red) curve: ensemble average (x(t)) of 200 realizations; thin 
(blue) curve: x(t) for one example trial; gray (green) curve: 
corresponding standard deviation <r x (t) ofx(t) for a fixed noise 
intensity D = 0.1. (b): (Green) crosses: standard deviation 
CrE(ioo) of ( x (t — 100)}; dashed (blue) line: standard devia- 
tion of the input noise given by D; black (red) curve: asymp- 
totic value -Koo of the feedback gain. Parameters: 7 = 0.001, 
x(0) = 0.05, y(0) = 0. Other parameters as in FigfTJ 



a gray (green) curve. The control is successful in all re- 
alizations: For large t the mean (x(t)} fluctuates around 
the fixed point value at zero, due to the finite number of 
realizations. The standard deviation approaches a value 
smaller than the standard deviation of the input noise. 

This is further elaborated in Fig. 0|b) , which depicts 
the standard deviation a x at t = 100 versus the noise 
strength D as (green) crosses. If D becomes too large 
the standard deviation exceeds the one of the input noise 
indicated by the dashed (blue) line. This is the case for 
D > 0.4. Then the control algorithm will generally fail 
(time series not shown here): The oscillations of x(t) be- 
come larger with increasing t. Accordingly, the standard 
deviation a x u) increases with t indicating that the dy- 
namics is dominated by noise which forces at least some 
of the realizations to diverge. The black (red) curve in 
Fig. [31(b) depicts the asymptotic value K^ of the feed- 
back gain. For intermediate noise strength, an increased 
feedback gain K compensates the influence of noise en- 
suring that the control is still successful. For too large 
D, K increases to a value beyond the domain of stability 
and stabilization cannot be achieved. 

We conclude that the adaptive algorithm is quite ro- 
bust to noise (the escape rate is vanishingly small for 
D < 0.4) and only fails for large noise (D > 0.4). Our 
method allows for finding the appropriate K for all values 



of t for which the standard Pyragas control stabilizes the 
fixed point and is able to follow slow drifts in the system 
parameters. 



Note that the method still works if the control term 
is added only to the x-componcnt. Then, using Q(x) = 
[x(t) — x(t — t)} 2 /2 as a goal function leads to qualita- 
tively very similar results. This observation becomes rel- 
evant for experimental realizations of the time-delayed 
feedback control when only certain components of the 
system under control arc accessible for measurements^. 



Next, we consider the ETDAS scheme^ 



where the ETDAS control force F can be written as 



F(t) = K^T R n [X(t - tit) - X(t - (n + l)r)] (12a) 



n=0 



= K 



x(t)-{i-R)Y J R n ~ 1 Mt 



K [X(t) - X(t - t)} + RF(t - t) 



(12b) 
(12c) 



X(t) =AX(t)-F(t), 



(11) 



Here, R G (— 1, 1) is a memory parameter that takes 
into account those states that are delayed by more than 
one time interval r. Note that R = recovers the TDAS 
control scheme introduced by Pyragas^. The first form of 
the control force, Eq. (|12a[) , indicates the noninvasiveness 
of the ETDAS method because X*(t - r) = X*(t) if the 
fixed point is stabilized. The third form, Eq. (|12c|) . is 
suited best for an experimental implementation since it 
involves states further than r in the past only recursively. 
To apply a speed-gradient adaptation algorithm for the 
feedback gain K, we follow the same strategy as before 
and choose the goal function as Q(x) = [(x(t) — x(t — 
r)) 2 + (y(t) - y(t - r)) 2 ]/2. Using again K = -j\7 K Q, 
we obtain for a diagonal control scheme 



K(t) = j{{x(t) - x(t - t-)) [(x(t) - 2x(t -t)+ x(t - 2r)) + RS x {t - r)] 
+ (y(t) - y(t - T ))[(y(t) - 2y(t - r) + y{t - 2r)) + RS v (t - r)]} 



(13) 



with the abbreviations 

oo 

S x (t) = Y^ R n [x{t - tit) - 2x(t - (n + 1)t) + x(t - (n + 2)r)] = [x(t) - 2x(t - r) + x(t - 2r)] + RS x (t - r) 

n=0 

C50 

S y (t) = J2 Rn W - nT ) - Mt - (n + l)r) + y(t - (n + 2)r)] = [y(t) - 2y(t - r) + y(t - 2r)] + RS y (t - r). (14) 



n=0 



In Ref. [i the domains of stability for which ETDAS 
works were obtained analytically. The intervals of r in- 
crease with R and are larger than in the case of TDAS 
(R = 0). 



Figure [5] depicts the transient time t c in dependence 
of t for R = 0.35 and 0.95 as (blue) crosses and (red) 
squares, respectively. The light (red) and medium (pur- 
ple) shaded regions indicate the ranges of stability of 
t— . For odd multiples of half of the intrinsic period 
T = 2tt/u}, i.e., r = T /2(2n + l),n G N, t c is small, 
demonstrating the efficiency of the adaptive algorithm. 
Towards the boundary of the domain of stability, tc in- 
creases but remains finite. The control algorithm only 
fails very close to the border of the intervals of r. We 
conclude that the adaptive control algorithm for ETDAS 
converges to appropriate values of K and stabilizes the 
fixed point even for parameters where TDAS fails. 



III. STABILIZATION OF AN UNSTABLE PERIODIC 
ORBIT IN THE ROSSLER SYSTEM 

In this section we apply the adaptive delayed feed- 
back control algorithm to the Rossler system which is 
a paradigmatic model for chaotic systems. The system 
exhibits chaotic oscillations born via a cascade of period- 
doubling bifurcations and is given by the following equa- 
tions including the control term: 

x(t) = -y(t) - z(t) - K[x(t) - x(t - t)] (15a) 
y{t) = x{t) + ay{t) (15b) 

z(t) = b + z(t)[x(t) - n}. (15c) 

In the following, we fix the parameter values as a = 0.2, 
b = 0.2, and /j, = 6.5 in the chaotic regime. Unstable 
periodic orbits with periods T\ ps 5.91679 (" period- 1 or- 
bit") and T 2 « 11.82814 ("period-2 orbit") are embedded 
in the chaotic attractor. As shown in Ref. |j by a bifur- 
cation analysis, application of the delayed feedback of 





FIG. 5. (Color online) Adaptive control of an unstable pe- 
riodic orbit in the Rossler attractor Eq. (|15[) . (a): Phase 
portrait (after a transient time of 150 time units), (b): Time 
series of K(t) with adaptive control given by Eq. (|16|l as solid 
(blue) curve. The dashed (red) curve shows the goal func- 
tion Q. Parameters: a = 0.2, b — 0.2, fi = 6.5, 7 = 0.1, 
r = 5.91679. 



mean (x(0)) = (y(0)) = (z(0)) = 0, respectively, and the 
standard deviations are c^o) = a y{o) = a z(o) ~ 1- It 
is assumed that the control goal is reached at time t c if 
the following condition holds: (Q) = J. c _ 2r Q(t')dt' < 
0.002t. 

Figure IS] depicts f c {l) ((red) circles) and t c (j) ((blue) 
crosses) demonstrating that the optimal adaptation gain 
is around 7 = 0.26. For 7 close to this value, the algo- 
rithm converges fast and reliably. Accordingly, the stan- 
dard deviation of t r is small. 
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FIG. 6. (Color online) Adaptive control of the Rossler system. 
Full (red) circles: fraction of realizations f c where the adap- 
tive control algorithm stabilized the orbit versus the adapta- 
tion gain 7; black (blue) crosses: Average time t c after which 
the control goal is reached versus 7; dotted (blue) lines: error 
bars (standard deviation) corresponding to t c . Other param- 
eters as in Fig. [S] Total number of realizations: 100. 



This demonstrates that for appropriate values of 7, the 
chaotic dynamics can be controlled. 




Pyragas type with r = T\ and 0.24 < K < 2.3 stabilizes 
the period- 1 orbit, and it becomes the only attractor of 
the system. In Ref. HH it was predicted analytically by a 
linear expansion that control is realized only in a finite 
range of the values of K: At the lower control boundary 
the limit cycle should undergo a period-doubling bifur- 
cation, and at the upper boundary a Hopf bifurcation 
occurs generating a stable or an unstable torus from a 
limit cycle (Neimark-Sacker bifurcation). 

We use Q(x) = [x(t) — x{t — t)] 2 /2 as a goal function 
and as in the previous Section obtain the speed-gradient 
adaptation algorithm for K—: 

K(t) =y[x{t)-x(t-T)][x(t)-2x(t-T)+x(t-2T)] (16) 

with the initial value K(0) = 0. 

Figure 03a) depicts the time series of a stabilized orbit 
for a time delay r = T1. Panel (b) shows that the adap- 
tation algorithm converges to an appropriate value of K 
and the cost function tends to zero. 

Contrary to the previous case, it is not possible to set 
the adaptation gain 7 to 1 by rescaling the system but 
the value of 7 is crucial for successful control. To explore 
the role of 7, we determine the fraction of realizations 
f c where the control goal is reached as a function of 7. 
The initial conditions arc Gaussian distributions with the 



IV. CONCLUSION 

In summary, we have proposed an adaptive controller 
based on the speed-gradient method, to tune the feed- 
back gain of time-delayed feedback control to an optimal 
value. We have shown that the adaptation algorithm can 
find appropriate values for the feedback gain and thus 
stabilize the desired periodic orbit or fixed point. This 
has been realized both for the stabilization of an unsta- 
ble focus in a generic model and the stabilization of an 
unstable periodic orbit embedded in a chaotic attractor. 
We have demonstrated the robustness of our method to 
different initial conditions and noise. We stress that this 
adaptive controller may especially be useful for systems 
with unknown or slowly changing parameters where the 
domains of stability in parameter space are unknown. In 
particular, we have shown by a simulation with a drifting 
bifurcation parameter A that our method is able to follow 
such slow parameter drifts. It should be noted that the 
automatic adjustment of the feedback gain K is possible 
without changing the value of the adaptation gain 7 of 
the speed-gradient method. This shows that the algo- 
rithm is robust and simple to apply. Our method might 
be used to tune more than one parameter, increasing its 
range of possible application. 
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